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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- tf the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )M Responsive to communication(s) filed on 16 June 2005 . 
2a)D This action is FINAL. 2b)M This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) [3 Claim(s) 12 and 14-22 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) IE Claim(s) 12 and 14-22 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1.85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. D Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 

Remarks to After Final Amendments 

1 . Applicants request for reconsideration of the finality of the rejection of the last Office 
action is persuasive and, therefore, the finality of that action is withdrawn. 

2. Claims 1-11, 13, and 23-33 were canceled. Pending claims are claims 12, and 14-22. 

Response to Arguments 

3. Applicants arguments with respect to claims 12, and 14-22 have been considered but are 
moot in view of the new ground(s) of rejection. 

Claim Rejections - 35 USC § 112 

4. The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

5. Claim 22 recites the limitation "to the more than one selected node" in claim 12 (refer to 
claim 12). There is insufficient antecedent basis for this limitation in the claim. 
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Claim Rejections - 35 USQ 102 

6. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless — 

(e) the invention was described in (1) an application for patent, published under section 122(b), 
by another filed in the United States before the invention by the applicant for patent or (2) a 
patent granted on an application for patent by another filed in the United States before the 
invention by the applicant for patent, except that an international application filed under the 
treaty defined in section 351(a) shall have the effects for purposes of this subsection of an 
application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

7. Claims 12, 14, and 21 are rejected under 35 U.S.C. 102(e) as being anticipated by Ahmad 
et al (U.S. Patent No. 6,263,507 or "Ahmad" hereinafter). 

Regarding claim 12, Ahmad discloses "a method of browsing a video using semantic 
relations information between segments of a multimedia stream characterized by a video 
browsing interface including a video display view and a key frame or a key region view, the 
method comprising: displaying the semantic relations information between segments by the 
video browsing interface further including key frames or key regions or text for displaying the 
semantic relations information between the segments; and performing a video browsing by using 
key frames or key regions or text displaying the semantic relations information between 
segments, wherein the semantic relations information between segments is an information on 
cause/effect or abstract/detail relationship 5 ', i.e., system as shown in Fig. 1 of Ahmad with a 
browser as shown in figure 2B for browsing a video using semantic relations information 
between segments, since segments are related to each other with additional related information, 
and the browsing including a video display view and a key frame or a key region viewing as at 
item 213 of Figure 2B, and the key frames are used for displaying the semantic relations 
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information between segments wherein the semantic relations information between segments is 
an information on abstract/detail relationship (refer to col. 2/line 60 to col. 3/line 59 for details of 
a subject matter, even between segments of different types, audio, video, and/or text data; and 
col. 16/line 55 to col. 17/line 57 & col. 18/lines 22-44 for keyframes and keyframes are used for 
displaying the semantic relations between related segments). 
(Claim 13 was cancelled). 

As for claim 14, in further view of claim 12, Ahmad discloses "wherein a user can select 
a case as to whether to shift to a frame corresponding to the selection region or to a segment 
represented by the selected region, or to a cause segment of the corresponding segment or to an 
effect segment or to an abstract segment or to a result segment, if the user selects a 
predetermined display region of the key frame or the key region view", i.e., the graphical user 
interface as shown in figure 2B allows the user to control the keyframes either to skip or shift, or 
to stop, or to select a selected region or to any segment to a category of interest (refer to col. 
15/line43 to col. 16/line 3). 

As for claim 21, Ahmad shows "wherein the region displaying the semantic relation 
information displays the region displaying the semantic relation information between segments 
centering around a segment currently being displayed" (Fig. 2B as the user selects an interested 
subject matter for displaying, the keyframe viewer shows the semantic relations information 
between segments). 
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Claim Rejections - 35 USC §103 

8. The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as 
set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious at 
the time the invention was made to a person having ordinary skill in the art to which said subject 
matter pertains. Patentability shall not be negatived by the manner in which the invention was 
made. 

9. Claims 15-20 and 22 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ahmad et al. (US Patent 6,263,507 Bl) in view of Peters et al (US Patent 6,374,336 Bl). 

As for claims 15 and 17, in further view of claim 12, Ahmad does not further discloses 
"wherein each segment is expressed by a node, and the relationship between the segments is 
expressed by a link in a region displaying the semantic relations information between segments" 
and "wherein the corresponding node and the link are displayed in a graphic structure in the 
region displaying the semantic relations information between segments"; however, this is well- 
known in the art for graphical presentation, people often uses a flowchart with nodes and links 
for representing and displaying the relationship and the graphic structure between two or more 
objects in the flowchart for the viewer easy to view the methods or concepts. In fact, Peters 
shows in figures 3-8 and 24 with flowcharts for steps of updating segment tables and creating 
segment table with nodes and links as mentioned. Therefore, it would have been obvious to one 
of ordinary skill in the art to further modify Ahmad 's system and method with graphical 
representation of nodes and links as shown in Peters' flowcharts for further demonstrating the 
semantic relations information between segments for viewing purposes. 
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As for claim 16, in further view of claim 15, Ahmad and Peters teaches "wherein each 
node is expressed by using the key frame, the key region or a text in the region displaying the 
semantic relations information between segments" (Fig. 2B of Ahmad for showing key frame, 
with node is taught by Peters). 

As for claim 18, in further view of claim 15, Peters shows "wherein the corresponding 
node and the link are displayed in a tree structure in the region displaying the information on 
semantic relations between segments" (Figs. 23 & 24 as in the form of a tree structure). 

As for claim 19, in further view of claim 15, Peters suggests "wherein the corresponding 
node and the link are displayed in other structures than the graphic structure or the tree structure 
in the region displaying the semantic relations information between segments, the corresponding 
segment and the segments related to the associate meanings being dynamically converted and 
displayed when a predetermined segment is selected" (Figs. 3-8 as a loop structure other than the 
tree structure). 

As for claim 20, in view of claim 15 above, Ahmand suggests this limitation as the 
graphical user interface as shown in figure 2B allows the user to control the keyframes either to 
skip or shift, or to stop, or to select a selected region or to any segment to a category of interest 
(refer to col. 15/line 43 to col. 16/line 3); therefore, is a node is selected, a shift is made to a 
corresponding segment. 

As for claim 22, in addition to the rejection 1 12-2 nd above, Peters shows "wherein the 
graphic view of semantic relations information selects a plurality of nodes, and the segments 
corresponding to the more than one selected node are automatically linked and reproduced" 
(Figs. 22-25). 
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Conclusion 



10. Any response to this action should be mailed to: 



Commissioner of Patents and Trademarks 



Washington, D.C. 20231 



or faxed to: 



(703) 872-9306, (for Technology Center 2600 only) 



1 1 . Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Kieu-Oanh Bui whose telephone number is (571) 272-7291. The 
examiner can normally be reached on Monday-Friday from 9:00 AM to 6:30 PM, with alternate 
Fridays off 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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Primary Examiner 
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KB 

July 28, 2005 



